Estimating Intrinsic Images from Image Sequences with Biased Illumination

نویسندگان

  • Yasuyuki Matsushita
  • Stephen Lin
  • Sing Bing Kang
  • Harry Shum
چکیده

We present a method for estimating intrinsic images from a fixed-viewpoint image sequence captured under changing illumination directions. Previous work on this problem reduces the influence of shadows on reflectance images, but does not address shading effects which can significantly degrade reflectance image estimation under the typically biased sampling of illumination directions. In this paper, we describe how biased illumination sampling leads to biased estimates of reflectance image derivatives. To avoid the effects of illumination bias, we propose a solution that explicitly models spatial and temporal constraints over the image sequence. With this constraint network, our technique minimizes a regularization function that takes advantage of the biased image derivatives to yield reflectance images less influenced by shading.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Recurrent Color Constancy Supplementary Material

Groundtruth Bias – We render all images in the linear SFU Gray Ball Dataset with respect to the linear groundtruth provided by the color constancy benchmarking website [1]. Among all rendered images, we find a number of these not in intrinsic color and not consistent in illumination with the preceding frames (Figure 1), which indicates the corresponding “groundtruth” is biased. The biased “grou...

متن کامل

Deriving Intrinsic Images from Image Sequences

Intrinsic images are a useful midlevel description of scenes proposed by Barrow and Tenenbaum [1]. An image is decomposed into two images: a reflectance image and an illumination image. Finding such a decomposition remains a difficult problem in computer vision. Here we focus on a slightly easier problem: given a sequence of images where the reflectance is constant and the illumination changes,...

متن کامل

Intrinsic Video

Intrinsic images such as albedo and shading are valuable for later stages of visual processing. Previous methods for extracting albedo and shading use either single images or images together with depth data. Instead, we define intrinsic video estimation as the problem of extracting temporally coherent albedo and shading from video alone. Our approach exploits the assumption that albedo is const...

متن کامل

Learning Intrinsic Image Decomposition from Watching the World

Single-view intrinsic image decomposition is a highly ill-posed problem, and so a promising approach is to learn from large amounts of data. However, it is difficult to collect ground truth training data at scale for intrinsic images. In this paper, we explore a different approach to learning intrinsic images: observing image sequences over time depicting the same scene under changing illuminat...

متن کامل

Illumination-invariant Image-based Environment Representations for Cognitive Mobile Robots Using Intrinsic Images

Image-based scene representations enable a cognitive robot to make a realistic prediction of its environment. Hence, it is able to rapidly detect changes by comparing a virtual image generated from previously acquired reference images and its current observation. This facilitates surprise detection and attentional control to novel events ([1]). However, illumination effects can impair attention...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2004